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University of Miami, Coral Gables, Florida 
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SUmiARY 

With the advent of microprocessor technology, it has become possible to 
automate many of the functions on the flight deck of commercial aircraft that 
were previously performed manually. However, it is not clear whether these 
functions should be automated, taking into consideration various human factors 
Issues. 

A NASA'industry workshop was held to identify the human factors issues 
related to flight-deck automation which would require research for resolution. 
The scope of automation, the benefits of automation, and automation-induced 
problems were discussed, and a list of potential research topics was generated 
by the participants. 

This report summarizes the workshop discussions presents the questions 
developed at that time. 


*Earl L. Wiener is with the Departments of Management Science and Industrial 
Engineering, University of Miami, Coral Gables, Florida 3312*1. He is a visit- 
ing research scientist at Ames Research Center under an Intergovernmental Per- 
sonnel Agreement. 



XHTRODOCTIOtl 


Modern aloroprocessor teohnology and display aysteaa aake It possible to 
automate many of the functions on the flight deck of ooaaerclal airlines that 
were previously performed manually. In fact, the question today Is not wheth- 
er a fUnctl<Mi can be automated, but rather should It be automated, taking Into 
consideration various humn factor Issues. Although there are many real bene- 
fits to be derived from automat l<m. It seems hlidily questionable tdiether total 
system safety Is always enhanced by allocating functions to automatic devices 
rather than humn operators. For a further discussion of these Issues, see 
references 1-5. 

A NASA-lndustry workshop was held on July 17 and 18, 1980, In Burlingame, 
California to discuss these Issues. The workshop was organized by Renwlck 
Curry, Earl Hlener, and Alan Chambers of the Man-Vehicle Systems Research 
Division of NASA, and administered by Science and Hutaan Values, Inc. The pri- 
mary objective of the workshop was tc define the Important research areas In- 
volved In the human factors of flight-deck automation and to create a list of 
general and specific research questions. 

Workshop participants (Appendix A) were drawn from NASA, the PAA, the 
RAF, airline companies, aircraft manufacturing companies, universities, and 
consulting firms. The participants were chosen for their expertise In automa- 
tion and human factors and their ability to contribute to the design of a 
research program In this area. The conference chairman was Renwlck Curry of 
Ames Research Center. 

The workshop comprised four major sessions: 

Session 1 : Group meeting to Introduce the participants and discuss the 
basic human factors Issues Involved In flight-deck automation. 

Session 2: Parallel group meetings to generate a list of Issues that re- 
quire research for resolution. This list was compiled In the form of a set of 
general research questions. 

Session 3: Group meeting to discuss research priorities. 

Session 4: Parallel group meetings to generate a list of specific 
research Issues within each general researc.i area. 


This report summarizes the research areas described by the participants 
and presents the questions developed during the workshop. 



SOHNART OP PLBMART SESSIONS 


Prior to the tforkehop* the participants tfere asked to consider three 
questions: (1) What is the soope of "autonation* in your field of interest? 
(2) Hhat benefits does autoaation provide? and (3) Hhat types of autoaation- 
induced probleos do you know about? At the beginning of the workshop, each 
participant was asked to address these questions briefly, and each 
partictpant*s coanents were followed by an open discussion. issues that 
arose as a result of this session are suoBarised here. 

Scope of Autoaation in Field of Interest 

The participants generally agreed that technology is now sufficiently ad- 
vanced so that it is theoretically possible to autocnte nost systems. Ifcwev- 
er, tine and cost constraints often iopose practical Units on the scope of 
autoaation. For example, in an accident investigation, someone with experi- 
ence usually goes out to collect information from the site of the accident and 
to talk to the people concerned. Although it might be possible to build an 
automated system to accomplish these tasks, such a system would probably be 
quite expensive to design and use; in addition, the solutions may not be an 
improvement over those provided by a human expert. On the other hand, fullv 
automated systoas such as autoland have been developed end implemented on the 
flight deck. 

The pres«mce of huKns in the processing loop also influences the scope 
of automation. The actual implementation of a system is limited by a pilot *s 
willingness to engage the system (where he has a choice). Anecdotal reports 
from flight crews have shown that pilots who arc not thoroughly familiar with 
a system, or who feel that the system does not perform as they would like, 
will not use that system. For example, because cf passenger complaints about 
excessive movement of the aircraft, pilots rarely engage the fully automatic 
VOR tracking mode of autopilots. 

Pilots are also unwilling to engage fully automatic systems for other 
reasons. When an automated system such as autoland is engaged, the pilot Is 
relegated to the role of a monitor, not a controller, and not only is this 
less challenging for the pilot, but it may lead to a decrement in the pilot's 
ability to land the airplane manually. 

The driving forces for automation were considered to be mainly economic 
and safety issues; however, it was pointed out that airlines have allowed new 
features to be introduced into aircraft simply because the manufacturer in- 
cluded them in the standard version of the aircraft. 

Benefits siL AMtOBAttOn 

Automation appears to provide two types of benefits. The first is that 
automation allows certain functions to be oerformed that could not be per- 
formed otherwise, either because humans are not capable of performing the 
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Ainottons, or because of oost» tioot or safety constraints Inposed by aan**al 
perforaance. For exaople, pilots are not alloued to land airplanes oanually 
In Category III weather conditions; they nay <mly Icuid the aircraft by engag- 
ing the autoland systra. 

The seoond type of benefit derives from the fact that autoeated systens 
are often able to provide a better solution to a problea than huaans. These 
benefits are seen In eany aspects of flying. Proa the systeas standpoint, au- 
tomted equlpaent aay be superior to husan perforaance for reasons of cost- 
effectiveness, reliability, or consistency. Proa the user standpoint, the 
benefits Include the possibility of the following: decreased workload, an In- 
creased safety aargln. Increased quality of life for the crew and passengers, 
the ease of learning to operate the systea, speed and convenience In actual 
use, increased operating efficiency, and Increased schedule dependability. 
For example. Increased passenger coefort and systee operating efficiency can 
be achieved by allowing a flight nanagenent systea to coepute a fllghtpath 
that avoids turbulence while at the sane tine conserving fuel. 

The participants also referred to several possible future benefits of au- 
tooatlon. If automation does decrease workload, creating spare tlice on 
flights. It night be possible to use that tine profitably by providing for 
on-board training. More attention to the design and use of displays may allow 
those displays to perform functions that they currently do not serve, such as 
serving as external •neraory aids. Moving map displays could provide not only a 
better representation of the exact location of the airplane at any eiven time, 
but also to remind the pilot that he is flying an airplane, not Just watch ine 
instruments. 

Automat ion-induced Frftbifiaa 

The problems cited by the participants included those that have already 
been encountered, as well as potential problems in the future. 

Violations of benefits - Problems are created by automation whenever the 
automated system does not actually provide I he benefits that have been claimed 
for it; that is, there will be problems if the automatic system is less reli- 
able, more costly to operate, or creates a heavier workload than the manual 
system it replaces, or if it creates a decreased safety margin or diminished 
quality of life. In practice, the participants felt that most first- 
generation automated equipment exhibits at least some of these negative 
features. The ground proximity warning system (GPWS), for examole, produced 
r.any false alarms when it was first introduced into the cockpit. ftlthouch 
succeeding generations of equipment tend to correct initial problems (e.g., 
GPWS), such has not always been the case. 

Crt'libilitv - The failure of automated equipment to function as expected 
leadc tc a problem of credibility. If users do not trust a system, they are 
not likely to use it. Credibility extends beyond a gross measure of use or 
nonuse, however. The limits to which a user trusts a system may vary as a 
function of past system performance ar well as the user’s knowledf.^ of a given 



system's accuracy. If atr traffic controllers are unaware that their consoles 
are capable of displaying lnf<Mi*natlon that Is accurate to within a few feet, 
they will not make appropriate use of the Information presented. On the other 
hand, people may determine locations on maps with greater care and accuracy 
than are warranted by the original data from which the map was drawn. 

Training - The development of a training program Is difficult tdiere au- 
tomated equipment Is Involved because users must be trained In two capacities: 
as monitors of the system when It Is In the fully automatic mode, and as con- 
trollers of the system when It Is In any other mode. The skills required to 
function In these two capacities are not only different, but often In conflict 
with one another. Controlling a system requires considerable knowledge about 
the system, proficiency In the manual skills required to operate the system, 
and flexibility In dealing with the system. The flexibility and individual 
differences that are beneficial In dealing with a manual system may create 
problems In dealing with an automated system. Conversely, prolonged use of a 
system In the automatic mode may lead to a deterioration of manual skills and 
a loss of proficiency, which may degrade performance on a manual system. 
Given the conflicting nature of the two functions, the decision about where to 
place priorities In training Is difficult. 

In normal use, the system operates In the automatic mode and the user 
does not need to call on special skills (which are expensive to train). The 
question then becomes one of cost-effectiveness; that Is, Is the time required 
to train users to deal with these rare events worthwhile? The answer to this 
question Is complicated by the fact that even after an Initial Investment in a 
full training program, an operator’s skills may have deteriorated to a non- 
useful level by the time any particular emergency arises that calls on tho?;e 
skills. The resolution of this problem may ultimately lie not In cost- 
e^'fectlveness, but In the question of liability; that Is, who Is responsible 
for an accident caused by the malfunction of an automated system. In avia- 
tion, the "conmodlty" at stake Is human life, and the cost associated with ad- 
ditional training may be worthwhile. 

The task of devising an adequate training program Is also hampered by the 
mixture of old and new equipment In cockpits. Often, pilots are trained on 
equipment that Is from a different generation (older or newer) than the equip- 
ment they actually use on the Job. An example was given at the workshop of a 
military officer who received extensive training on a fourth generation con- 
sole. When he reported ''or duty, he was confronted with a first veneration 
piece of equipment. He sat there and looked at It for a while and said "Oh, I 
remember that. In the museum at the school they had that locked up In a 
casu." This problem Is not restricted to new pilots; a similar problem occurs 
when pilots transfer from one type of aircraft to another. 

Although It Is purported that automated systems are easy to learn. In 
practice, some of the participants have found that the new systems are harde*' 
to learn than the old ones. This Is due in part to the fact that newer sys- 
tems often perform more functions and are generally more complex than the sys- 
tems they replace. 
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The tntroduotton of aut<Hnated equipment on the flight deck also may Imply 
a need to make a change In the pilot selection process. It may be that the 
current pilots, who are good controllers, will not make good monitors. If 
this Is the case, the selection procedures may need to be changed In the fu- 
ture. 

System design - Currently, when new systems are developed and tested. It 
Is done with an eye toward the benefits the new system will provide. The par- 
ticipants felt that too little attention had been paid td the shortcomings of 
the system. Failure to anticipate problems usually leads to "band-aiding" the 
system rather than redesigning It, and this was seen as a problem. For exam- 
ple, there has been some discussion about displaying Air Traffic Control (ATC) 
clearances on a CRT In the cockpit rather than sending them out by voice 
transmission. The proponents of this approach point out that this will reduce 
pilot errors that are due to misunderstanding the stated altitude. The pro- 
ponents fall to point out, however, that pilots would then be subject to read- 
ing errors, which may or may not occur as frequently as hearing errors. Pi- 
lots may also lose their sense of where other aircraft are located, which they 
now deduce from hearing clearances for all the aircraft in their vicinity. 
Another example of a design-induced error can be seen in flight management 
systems, where incorrect data entered by way of the console can be disastrous. 
Incidents have already occurred using the inertial navigation system (INS), 
with pilots entering incorrect Information about their waypoints. 

Another problem stems from the fact that most systems are designed for 
use by individuals, not by teams. Airline pilots usually function as part of 
a two- or three-person crew and the participants felt that this should be con- 
sidered when systems are designed. 

The participants were also concerned with the manner of presenting infor- 
mation to the pilots. They pointed out that information must be presented in 
a way that minimizes ambiguity and inaccurate interpretation of the informa- 
tion which might lead tu misdiagnosis of a problem. 

System use - When an automated system is functioning properly, the pilot 
will be relegated to the role of a monitor for that function. It was felt 
that pilots might not find this role as challenging as their current role and 
that this might lead to boredom or "complacency." Although boredom and compla- 
cency were not actually defined, these terms might encompass reactions such as 
pilots falling to "stay ahead of" or even to just "stay up to date" with the 
current status of the flight. This could lead to disastrous results if the 
pilot is forced to take over the controls suddenly because of an emergency. 
In addition to the normal "warm-up" time required to make the transition from 
monitor to controller, there will be the time required to ascertain the 
current status of the airplane and assess the situation. 


Later in the workshop, the participants were asked to put themselves in 
the position of a research manager who was given the task of deciding how to 



establish priorities for spending research ooney. They were asked what cri- 
teria they would use to assess a research program before making this decision. 
A number of |w>tentlal criteria were suggested! but no consensus was reached as 
to which questions were crucial. This summary! then! reflects suggestions 
from Individual participants. 

The first criterion suggested was how Important the answer provided by a 
given piece of research might be toward reaching the final goal. Although the 
participants felt that this was a worthy consideration! they pointed out that 
Importance was not operationally defined and that perhaps the question should 
be phrased In terms of how long It would take to get a payoff from the 
research. They also pointed out that some research that Is Important may be 
very difficult! or impossible! to carry out. In some areas! researchers have 
been unable to develop adequate performance measures. In other areas! the 
problems do not become apparent until after long-term Interaction of pilots 
with the system, making research on these types of problems very difficult In 
a laboratory setting. For example, the loss of flying skill that can accom- 
pany the use of more advanced, more automated airplanes did not become ap- 
parent until a number of co-pllots on these aircraft were upgraded and as- 
signed as captains to less advanced aircraft. 

Another consideration Is the timing Involved. The participants felt that 
NASA should address Issues related to systems that are currently on the draw- 
ing board as well as longer-term Issues. However, there was a consensus that 
If research could not be completed In a timely fashion, there was little pur- 
pose In Initiating It. Some questions need to be answered so quickly that It 
Is Impossible to carry out the appropriate research. 

The participants also suggested that consideration should be given to the 
story of the problem; that is, how big Is the problem, how much work has al- 
reacy been done In this area, and do the answers already exist? In answering 
these questions. It will be important to assess how directly the existing 
research addresses the current problem. For example, there Is a current con- 
troversy over the mandatory retirement age of 60 for air carrier pilots. 
Although there is a large body of research that shows the effect of age on 
variables such as choice reaction time, psychorootor skills, and cognitive 
skills, the evidence does not directly address the effect of age on the abili- 
ty to fly an airplane. 

Lastly, the participant? suggested that It Is Important to consider the 
goals of the organization doing the research and whether the proposed research 
Is directed toward those goals. In the context of the workshop, the partici- 
pants suggested that NASA should be Involved In high-risk, long-term ventures 
that try to answer some of the larger questions rather than short-term ven- 
tures that answer design questions. They also felt that NASA should be work- 
ing toward creating a "handbook" of guidelines for the industry and that this 
handbook should Include standards for things that should not be done as well 
as for things that should be done. The participants suggested that this hand- 
book might also contain some sort of "sensitivity curves" to show how the 
ability to perform a given task decays as a function of the time elapsed since 



8 - 


the task was last parforasd. 

These suggestions led to a dtsousston of whether such a handbook would 
actually be used and to the more general question of how to Implement the 
findings from human factors research. A large body of human factors research 
has been produced over the last AO years and the participants felt that the 
systems designers have not always used that inftxNnation; however, no oonsmsus 
on how to alleviate this problem was reached. 



SUMMARY OP PARAaSL SESSIONS 


ttwaLigti fiOCBaUfclQn 

The primary object Ive of the Norkahop was to develop a list of research 
topics on the human factors of flight-deck automation. In the second and 
fourth sessions of the workshopi the participants were divided Into two groups 
of equal slae. In the second session, the groups were formed so that the mix- 
ture of background Interests would be roughly the same In both groups. Bach 
group was asked to generate a list of 25 to 30 broad subjects for automation 
research. They were asked to choose topics that were not so broad as to pro- 
vide little or no guidance, but which were not so specific that a single simu- 
lation or analysis would answer the question. In the fourth session, the par- 
ticipants were divided so that those with applied backgrounds were in one 
group, and those with basic research backgrounds were In the other group. In 
this session t the participants were asked to generate more specific research 
questions to comolement the broader questions generated during the previous 
session. 

The questions generated by all of the groups were complied in a single 
list. The questions were reworded as necessary to avoid ambiguity and redun- 
dancy, and they were grouped Into six categories: systems questions, Implemen- 
tation, methodology, selection and training, man-machine interactions, and 
field studies. This classification process proved to be difficult since many 
categorizations were possible, and since within any given classification sys- 
tem, questions were often related to more than one category. This was espe- 
cially true for the man-machlne-interactlon category. Subcategories reflect- 
ing the human side of the Interaction were used (e.g., use of Information, 
representation of Information), but equally feasible subcategories describe 
the task (e.g., controlling, monitoring, planning, declslon-maklng) . These 
task-related aspects are Incorporated In the list although they are not 
highlighted. It should also be noted that the order of the categories and of 
the questions within each category does not reflect the relative Importance of 
the questions. 
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flUftaUpna RsmrUng FlUhfeHBflaK Automation 

The complete list of questions oan be found In appendix B. For the pur- 
poses of brevity, only the major questions under each heading are Included 
here. Questions under second level headings In section 5 (5.1, 5.2, etc.), 
were deleted for the sake of clarify. 


1. SYBtiMa fittaffllaag. 

1.1 How can levels of cockpit automation be varied to make them compatible 
with the ATC system? 

1.2 How can the benefits and costs of automation be assessed? 

1.3 What techniques can be developed for testing system Integrity and Immunity 
to human error, particularly to errors arising from use/mlsuse of the hardware 
and software? 

2. imEijgafnfea-Uan 

2.1 What attributes of automation Influence Its accectabtlity and use? How 
can attitudes toward automation be modified? 

2.2 To what extent must Individual models of aircraft be considered In making 
design recommendations and guidelines? 

3. MstJlQdffllflmL 

3.1 Can better ways of measuring crew performance levels and crew workload 
levels be found? 

3.2 Can efficient techniques be designed to Investigate rare failures In man- 
machine systems? 

4. Selection Training 

4.1 What are the Implications of automation for crew selection 
criteria/methods? 

4.2 What are the problems associated with the transition of pilots across air- 
craft types and different generations of automated equipment? 

4.3 How does automation affect the acquisition and retention of psychoraotor 
and cognitive skills? 

4.4 To what extent Is on-board training feasible and beneficial? 

4.5 Will older or highly experienced pilots be able to adapt readily to ad- 
vanced equipment? If not, what procedures can be developed to lessen the 
problem? 
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5. ItoBrftteLQMtta IntBPaotlon 

5.1.1 How should deoision-aldlng and deolalon-oaking tsohnlquss be used? 

5.1.2 How oan data transfer between the devtoe and the crew be Improved by ef- 
fect ive systems dest^i? 

5.2.1 How much systems Information should the operator be given? 

5.2.2 How should information given to the operator be represented? 

5.3*1 What features of tasks make them easy or difficult? 

5.4.1 What are the advantages and disadvantages of the human monitoring the 
automatic system, rather than actively controlling it? 

5.4.2 What can be done to improve the performance of the human jcting as a 
monitor, particularly in his failure-deteoting/oorrecting abili*” { 

5.4.3 How will the automatic system and the operators deal with unforeseen and 
unplanned circumstances? 

5.5.1 Are there negative psychosocial consequences of automation? 

5.5.2 To what extent does increased automation lead to boredom and complacen- 
cy? 


5.6.1 How should operational procedures for highly automated aircraft be 
designed? What callouts should be made? By whom? How and when should check- 
lists be used? 

5.6.2 How does automation Influence the choice of crew size and the role that 
each crew member plays? 

5.6.3 Apart from crew size, how does automation affect the organization and 
operation of the crew as a team? 

6. Studies 

6.1 Develop a data base, a data base system, and a data collection system for 
doing research on operational history and operating experience with automated 
systems. Use this data base to identify today's critical problems. 

6.2 Use case studies of past commercial aircraft and appropriate military air- 
craft to examine past automation decisions. 

6.3 Conduct a user survey to determine attitudes toward the use of currently 
available automation. 

6.4 Perform an observational study to dete^'mine actual use patterns for au- 
tomated equipment. 

6.5 Conduct a risk assessment survey of the use, nonuse, or misuse of automat- 
ed features of aircraft to identify the current problems. 
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HORKSiOP SOMHARl 


There was no formal definition of the term "automation* proposed at the 
workshop, hut the ooei'ating definition seemed to be the allocation of tasks (a 
task performed bp a machine was considered to be automated even if both the 
huran and the machine were performing the same task in parallel). This defin- 
itltm led to the consideration of questions in many disciplines, e.g., train- 
ing, equipment design, interactive systems, planning, and decision making. 

Not surorisingly, the majority of research topics produced by the 
%(orkshop (about 751) concerned Kan-Machine Interaction, although the impact of 
automation in other areas was not overlooked. He asked the participants, 
while reviewing a draft of this report, to rate the major research areas (pp. 
10-11) in terms of the importance and urgency of the information in that par- 
ticular area. Th.s was not an easy task, primarily because of the wide 
differences in specificity of the topics. The compilation of the ratings 
showed a consensus that the most Important/urgent topics were 1.3 (What tech- 
niques can be developed for testing system integrity and immunity to human er- 
ror...) and 5.b.3 (How will the automatic system and the operate*' deal with 
unforseen and iniplanned circumstances?). The least Important/urgent topics, 
according to the ratings, were 5.5.1 (Are there negative psychosocial conse- 
quences of automation?) and 2.2 (To what extent must individual models of air- 
craft be considered in making design recommendations and guidelines?) 

Although the list of research issues generated in the workshop is a broad 
one, we recognize that some topics of interest may not have been covered and 
invite suggestions for additional topics to be Included. 
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aiMiirtty a 

OiiMttQna ■aayrdtna FIlght-PaiA Aiita—tiaii 


1. Svattaa OttMttoM 

1.1 How o«n l«w«l« of oookptt witoMtton b« varlod to tHoa Qoapottblo 

with tho ATC svstwT 


1.2 How oan tbo bwonts and costs of sutoostton bs sssssssd? 


1.3 Hhat ts<^tqttss osn bs dsvslopsd for testing system Integrity and Isaunlty 
to huasn error, psrtloulsriy to errors arising froa use^lsuse of the hardware 
and software? 


2. lapieagnuUfln. 


2.1 What attributes of sutoaatlon Influence Its acoeptablllty and use? How 
can attitudes toward automation be aodlfled? 


2.2 To what extent must Individual models of aircraft be considered In making 
deslipi recommendations and guidelines? 


3. Methodology 


3.1 Can better ways of measuring crew performance levels and crew workload 
levels be found? 

3.1.1 What are the ways In which the flight crew might be assisted to 
determine their own workload level In order to smooth out the peaks and 
troughs which are now common? 


3.2 Can efficient techniques be designed to Investigate rare failures In nan- 
machine systems? 


4. Selection goil TriUling 

4.1 What are the Implications of automation for crew selection 
crlterla/nethods? 
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%.2 Wait are the probleas aesootated with the tranattlon of pilots across air- 
craft typM and dtffcraat aeneratlcna of autonatcd equtpaantT 

h .3 Row does aatoaatloo affect the acqutattton and retention of paychonotor 
and cognitive ekllls? 

4.3,1 Bow ifalokly do nanual and cognitive akllla deteriorate with lack of 
uaet Hhat factors Influence the rate of loss? 

4 3.2 Wait factors lead to an Increase in the retratlon of infrequently 
used akllla? 

4.3.3 Can autonatlon be used to successfully Increase the rate of skill ac- 
quisition in coDplex tasks by autonating sone of the subtasks? 

4.3.4 Wist is the effect of systea cooplexlty on crew training and the re- 
tention of training? 


4.4 To what extent is on-board training feasible and beneficial? 

4.4.1 Can coaputer-aided learning/ instruction (CAL/I) be used for specific 
on-board training, e.g., eaergency procedures? 

4.4.2 Hill on-board training help in nalntainlng proficiency and ability to 
handle sudden and unexpected critical events? 

4.4.3 Does on-board training entail any risks? 


4.5 Will older or highly experienced pilots be able to adapt readily to ad- 
vanced equipoent? If not, what procedures can be developed to lessen the 
problea? 


5. tfan-Machine Interaction 


5.1 JIa£ Inforaattop 

5.1.1 How should decision-aiding and decision-aaking techniques be used? 

5. 1.1.1 Does this technology cause the pilot to be nore detached from 
his aircraft and the real world? If so, what are the consequences of 
this? 

5. 1.1.2 To what extent should strategic planning (routes, clearances, 
etc.) be handled on the flight deck rather than on the ground? 

5. 1.1.3 Can this technology be used to allow for in-flight alternate 
planning? 
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5. 1.1.4 Cmi autoowtlon be used to mke oeutton and alerting systems nore 
oonprehenstble* and perhaps "tntelltsent**? How oan these systeias be 
evaluated? 

5. 1.1.5 When will the pilot accept the conclusion of the "'imart*' system 
and when will this conclusion be questioned and challeniKd? 

5. 1.1. 6 What are the characteristics of an Ideal (but attainable) alert- 
ing and warning systeo? 

5.1. 1.6.1 What are the most effective kinds and amounts of diagnostic 
infomatlon the pilot can use In the time he has available? 

5. 1.1. 6.? Can the format of dlaenostlc Information be adapted as a 
function of how the pilot seeks Information about the system? 

5. 1.1. 7 1/hat events lead to a Rineral or permanent distrust of automated 
devices? 

5. 1.1.8 When a decision aldlne device presents the user with a decision, 
how much Information should the user be ftven about the factors which 
have and have not been considered In nakln*^ the decision? 


5.1.2 How can data transfer between the device and the crew be Improved by 
effective systems desten? 

S. 1.2.1 Should system lanpuac^es be written to match the ‘’mental model" 
of the pilot? 

5. 1.2.2 How oan data bases be constructed and accessed to assure speed, 
convenience to the crew, and their full utilization? 

‘i.1.2.3 How should on-board displays be designed and used to reJuce the 
short-term and lon^-term memory load? 

5. 1.2.4 What are the significant variables Influencing decisions use 
various input devices; multimode keyboards, dedicated kevpoards, and 
voice-actuated controls? 


‘^•2 RgargaanVat Igg <iX. Iaf‘arMtlQn 

*5.2.1 How much sy3te*ns Information should the operator be clven? 

1 What effect does the amount of knowled«te about thr 
on system performance (normal and failure t?K>des)? 

5.2.1.? Should system Integrity Information be available to the 
crew at all times? 
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5*2. 1.3 Hew oan softw&r* «rrors te d«teot«d and tdmttftad so that ap* 
pr<H)rlata warning oan ha auppllad to tha flight oraw? 

5.2. 1.9 Wiat la tha rola of tlaa-basad Infomatlem (hlatorloal or 
pradlotlva) In autooatad ayat<ma7 

5. 2.1. 9.1 How oan "tha tlM dlmnslMi* (hlatorloal and (Nradtotlva tn» 
fwatlm) bast ba rapraawited on tha pilot* a display? 

5.2. 1.9. 2 Nhat la tha affaot on pilot perforaanoa of providing a 
pradlotor display of various alroraft paraiMtm’Sf suoh as alrspaad, 
altitude, and position? 

5. 2. 1.9. 3 Will tha afflolanoy of a pradlotor davloe daoay over time 
and baooaa datriaantal If It pradlots too far ahead? If so, is tha 
daoay f^otlon for aural and visual sodas different? 

5.2.2 How should Inforaatlon given to tha operator ba raprasentad? 

5.2.2. 1 How can tnforsatlon ba coded to show Its acoursoy and reliabili- 
ty? 

5. 2. 2. 2 If tha autooatic device Is changing the system configuration, 
should It make the change automatically and Inform the operator, or make 
the change only after operator acknowledgment? Should It tell the 
operator why It Is making tha change? 

5.2.2. 3 What are tha relative merits of visual versus auditory communi- 
cation for air-ground dialogues? 

5. 2. 2. 3.1 Is It Important that the mental Image of the surrounding 
traffic, developed by auditory communication, might be destroyed idien 
the visual display of ATC communication Is used? 

5. 2. 2. 9 How can pilots* mental models of systems be determined? Are the 
mental models of different pilots sufficiently similar for It to be 
feasible to complement their mental models In display presentations? 

5. 2. 2. 5 Can automation Improve the extent to which on-board aircraft 
systems can be temporarily modified, or altered, to better accommodate 
Individual differences among crews and/or crew members? 

5. 2. 2. 6 When should the Information content of displays be controlled 
automatically and when should It be controlled manually? 



5.3 Iifflk leatjyicaa 


5.3.1 What features ot tasks make them easy or difficult? 

5. 3. 1.1 What features make tasks easy or difficult to time-share? 

5. 3. 1.2 What features make tasks sensitive to Interruptions? 


5.4 Monitoring Aspects 

5.4.1 What are the advantages and disadvantages of the human monitoring the 
automatic system, rather than actively controlling It? 


5.4.1. 1 How should the operator perform as svstens degrade? How will 
the system communicate Its failure to the operator? 

5. 4. 1.1.1 Can a diagnostic computer be used to tell the operator the 
degree to which he must assume active participation In control, In- 
creased monitoring, or further Investigation of problems? 

5. 4. 1.1. 2 Given that a system failure does not Involve a loss of 
function or have Inanedlate detrimental consequences, what Information 
about the failure, If any, should the pilot be given? 

5.4. 1.2 How will the system become aware of and deal with human failure? 

5. 4. 1.2.1 What are the problems associated with flight crew data en- 
try errors In present (e.g., INS and ACARS) and planned (e.g., P-767) 
cockpit man-computer Interfaces? 

5. 4. 1.3 What are the advantages and disadvantages of the prioritization 
of alarms? 

5. 4. 1.4 Can functional tasks and displays be devised that will keep the 
aircrew member "In the loop"? Is this always desirable? 


5.4.2 What can be done to Improve the performance of the human actlne as a 
monitor, particularly In his fallure-detectlng/correctlnv ability? 

5.4.2. 1 Is there a "warm-up" delay when he transitions from oasslve mon- 
itor to active controller In the event of a failure? If so, can this be 
prevented by system design? 

5. 4. 2. 2 How can monitoring of the other crew members* functions be per- 
formed In other than a random manner? Can or should It be more systema- 
tized as Is supposedly done during final approach? 
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5*4*2.3 Row oan monttorlng be improved In highly diatraottve sltuatlon8» 
•uoh ae Intense oonmintoatlons worlcload» unant lotpated ohas^ea In plan, 
aystm or other emergmoles? 

5»4*2.4 Does automation lull the monitor Into atates of low alertness 
when he Is primarily a monitor? Can the operator-monitor be easily dis- 
tracted from his monitoring task by unimportant stimuli (e.g. , casual 
conversation)? 

5*4*2.5 Wist are the behavioral and performance differences between sim- 
ple and oomplex monitoring tasks? 

5*4. 2*6 What means are available (or oould be developed) for maintaining 
a monltor*8 alertness? Artlflolal signals? Will additional workload 
help or harm primary monitoring task perf<»*manoe? 


5.b.3 How will the automatic system and the operators deal with unforeseen 
and unplanned clroumstanoes? 

When these occur suddenly, and the human must assume control, 
how can a smooth transition take place? How will It be determined that 
a transition Is necessary? What are the human limitations In dealing 
with these problems? 

5. 4. 3. 1.1 Is the ability to make a smooth transition condltlonable or 
trainable? If so, how? 

5. 4. 3. 1.2 How Is pilot reaction time and correctness of response af- 
fected by early warning of Impending reversion to another operational 
mode? 

5.4.3. 1.3 To what dearee can procedural precautions minimize pilot 
reaction time and enhance the probability of correct Initial Input? 

5. 4. 3. 1.4 What role does startle threshold/reaction play? 

5. 4. 3. 1.5 Under what conditions should flight control systems fall 
active, passive, or safe? 

5. 4. 3. 1.6 To what degree can initial and recurrent training minimize 
the undesirable effects of such reversions? 

5. 4. 3. 1.7 What effect will training have on user confidence In, and 
willingness to use, the automated equipment? (worst case/time train- 
ing?) 


5.5 Psychosocial AaPAB-tja 

5.5.1 Are there negative psychosocial consequences of automation? 



If so, what preoautlons and/or remedies will be effective? 

5.5>1.2 How will automation Influence Job satisfaction, prestlite, and 
self-concept? 


5.5.2 To what extent does Increased automation lead to boredom and compla- 
cency? 

5.5.2. 1 What causes boredom? 

5. 5. 2. 2 Can people be trained to cope with boredom? 

5. 5. 2. 3 What kind of nonproductive or hazardous behavior Is apt to 
result from boredom? 

5. 5. 2. 4 Are Individual differences In boredom and complacency operation- 
ally Important? How are these differences measured? 

5. 5. 2. 5 Can techniques, methods, or systems be designed to reduce or el- 
iminate boredom and complacency? 

5. 5. 2. 5.1 Can vigilance be Improved by filling periods of Inactivity 
with other activities (e.g., computer games, advance planning, re- 
fresher training)? 


5.6 Resource HanaRg.mgnt 

5.6.1 How should operational procedures for highly automated aircraft be 
designed? What callouts should be made? By whom? How and when should 
checklists be used? 


5.6.2 How does automation Influence the choice of crew size and the role 
that each crew member plays? 

5.6.2. 1 How does automation affect the role of a pilot In a one-person 
crew, such as In commuter airlines? 


5.6.3 Apart from crew size, how does automation affect the organization and 
operation of the crew as a team? 


6. £igH 


6.1 Develop a data base, a data base system, and a data collection system for 
doing research on operational history and operating experience with automated 
systems. Use this data base to Identify today's critical problems. 



6*2 Use oess studies of pest oosmrolsl slrorsft end spproprtsts ntlltary str- 
orsft to sxsmtns pest sutoontlon dsolslons. 

6.2.1 Compere ooeewrolsl end silltspy design deolstons. 

6.2.2 Hotroepeotiyely, use the deotston to eutonete e funotlon suoh es au- 
toland e wise one? Wiy? 

6.2.3 Nhat nee right end «dmt use wrong with the Implementation and Intro- 
duetlon of the automated systems? 


6.3 Conduct a user survey to determine attitudes toward the use of ourrently 
available automation. 


6.4 Perform an observational study to determine actual use patterns for au« 
tomated equipment. 


6.5 Conduct a risk assessment survey of the use, nonuse, or misuse of automat- 
ed features of aircraft to Identify the current problems. 



